Candidate evaluation strategies for improved difficulty prediction of language tests
نویسندگان
چکیده
Language proficiency tests are a useful tool for evaluating learner progress, if the test difficulty fits the level of the learner. In this work, we describe a generalized framework for test difficulty prediction that is applicable to several languages and test types. In addition, we develop two ranking strategies for candidate evaluation inspired by automatic solving methods based on language model probability and semantic relatedness. These ranking strategies lead to significant improvements for the difficulty prediction of cloze tests.
منابع مشابه
Predicting the Difficulty of Language Proficiency Tests
Language proficiency tests are used to evaluate and compare the progress of language learners. We present an approach for automatic difficulty prediction of C-tests that performs on par with human experts. On the basis of detailed analysis of newly collected data, we develop a model for C-test difficulty introducing four dimensions: solution difficulty, candidate ambiguity, inter-gap dependency...
متن کاملA Study of Reading Strategies Using Task-Based Strategy Assessment*
In the present study, an exploratory approach (Oxford, Cho, Leung & Kim, 2004) to language learning is adopted which holds that the number and type of strategies used by Iranian learners might vary with respect to the difficulty of task and their L2 proficiency. In this regard, the term task is defined, its leading dimentions and charecteristics are put forward, and the nature of learning start...
متن کاملExamining the Features of an English Language Test: Reliability-related Issues
Most universities across Iran tend to develop English tests for placement, exit, achievement, and other purposes. Examining the various features of such tests is imperative for making informed decisions about learners’ achievement level. The present study examined the features of a university-wide administered English language achievement test at Iran University of Science and Technology (IUST)...
متن کاملLanguage Learning Strategy Use and Prediction of Foreign Language Proficiency Among Iranian EFL Learners
The purpose of this study was twofold. Firstly, it attempted to investigate whether language learning strategies (LLSs) can predict foreign language (FL) proficiency. Secondly, it examined what kind of LLSs Iranian learners of English use more frequently in FL institutes. To do so, 112 intermediate Iranian EFL learners participated in the study. Oxford’s Strategy Inventory for Language Learning...
متن کاملImpact of Online Setting Collaboration through Strategy-Based Instruction on EFL Learners’ Self-efficacy and Oral Skills
This study aimed to investigate the impact of web-based cooperative teaching through strategy-based instruction on EFL learners’ speaking and listening skills. Moreover, the use of cooperative teaching was hypothesized to have impact on the EFL learners’ self-efficacy. To this purpose, the study followed a mixed-methods design by implementing both qualitative and quantitative data gathering pro...
متن کامل